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FOREWORD 


This report is a technical summary of the progress made by the 
Electrical Engineering Department, Auburn University, toward fulfill- 
ment of Contract NAS8-26580 granted to Auburn Research Foundation, 
Auburn, Alabama. This contract was awarded November 15, 1970, by the 
George C. Marshall Space Flight Center, National Aeronautics and 
Space Administration, Huntsville, Alabama. 
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SUMMARY 


Some problems associated with the design of model-reference adaptive 
control systems are considered and solutions to these problems are 
advanced. The stability of the adapted system is a primary consider- 
ation in the development of both the time-domain and the frequency- 
domain design techniques. Consequentially, the use of Liapunov's 
direct method forms an integral part of the derivation of the design 
procedures. The application of sensitivity coefficients to the design 
of model-reference adaptive control systems is considered. An appli- 
cation of the design techniques developed herein is also presented. 
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I . INTRODUCTION 


The control requirements necessary for many of today's complex phys- 
ical processes has fostered the search for control methods which provide 
better performance characteristics than could be obtained with conven- 
tional control methods. For example, the use of computers in the control 
loop of complex industrial processes is commonplace. In addition, con- 
siderable research effort is being expended in order to provide systems 
with the capabilities to "adapt" themselves to a changing environment so 
as to maintain satisfactory performance characteristics throughout the 
entire environmental profile. The need for satisfactory performance of 
a control system in a changing environment or with inadequately defined 
parameters is not new. Indeed, one of the reasons for the use of feed- 
back control systems is the inherent capability of the system to be 
somewhat insensitive to changes in the controlled process. However, for 
some physical processes, conventional methods are inadequate and other 
methods of control are necessary. 

The interest in adaptive control has been generated largely because 
of a number of problems which could not be solved using conventional de- 
sign techniques. Such a situation might develop when the plant param- 
eters change grossly during the operation of the system. To further com- 
plicate the problem, the environment in which the plant is operating may 
also be changing drastically. These variations will not, in general, be 
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deterministic. Some may be predicted by statistical methods while others 
may be totally unpredictable. Specifically, high-performance aircraft 
and missiles have widely-varying parameters and in many cases operate in 
extremely different environmental characteristics during the operation 
profile of the mission. Some extensive bibliographies of research in 
the adaptive control area have been compiled [1], [2], [3]. In addition 
to a general adaptive control bibliography, reference [3] also contains 
compilations of research effort in particular areas of adaptive control 
such as adaptive process controllers and identification. 

There appears to be no universally accepted definition for an adapt- 
ive control system. Henceforth, an adaptive control system will be de- 
fined as: 

Definition 1-1. An adaptive control system is a system which 
monitors some of the plant characteristics, compares this with the 
desired characteristics and uses the difference to provide adaptation 
so that the desired performance may be obtained. 

There are, essentially, two basic approaches to the adaptive control 
problem. One approach which may be referred to as an "open-loop" policy 
is the preprogrammed adaption scheme. In this approach the plant de- 
scription, the environmental conditions, and a performance criterion are 
assumed to be known. The adaptive parameters are then determined so as 
to be optimum with respect to the given performance index. Environmental 
measurements are then made and parameters adjusted based on these mea- 
surements. For proper operation, this scheme requires accurate knowledge 
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of the plant and extensive information regarding the relationships of the 
measured environmental quantities to the system characteristics. These 
relationships as well as accurate identification of the plant may well 
be very difficult to ascertain. 

The second approach, which is of primary interest, may be referred 
to as "closed -loop". Here, the performance criterion is continuously 
monitored and this information is used to adapt the system so that the 
desired performance characteristics are obtained. This "closed -loop ' 
property provides increased system reliability since the adaptive scheme 
has the capability of achieving satisfactory performance despite failure 
of some of the system components. The "closed-loop" concept of adaptive 
control systems is of major concern and will be considered in the fol- 
lowing . 

A. Classification of Adaptive Control Schemes 

Adaptive control systems may take many different forms. Three 
classifications of adaptive control systems which encompass most of the 
different schemes are 

(1) High-gain schemes, 

(2) Optimal adaptive methods, and 

(3) Model-reference adaptive control systems. 

In general, the high-gain schemes are the simplest types of adaptive 
control systems while the optimal adaptive methods are the most complex 
of the three classifications. 
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1 . High-Gain Adaptive Control Systems 
The basic premise behind the high-gain schemes is that if the loop 
gain around a plant is kept sufficiently high, the input-output transfer 
function is virtually independent of the plant dynamics. 

This scheme is exemplified in Figure 1-1. From Figure 1-1, the 
transfer function from S to C is 


C(s) 

S(s) 


KG p (s) 

1 + KG p (s) 


(I-D 


Assuming that 


|KG p (s)| » 1, 


( 1 - 2 ) 


the transfer function from S to C is 


C S*). = i (1-3) 

S(s) 


Under this assumption, the transfer function from the actual input R to 
the plant output C is 


C(s) 

R(s) 


Gb(s) 


(1-4) 


Thus, the transfer function from input to output is approximately equal 
to the arbitrarily specified model transfer function and is essentially 
independent of the plant dynamics. In practical systems, however, 
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stability problems arise with increasing values of gain. Because of 
this, it is necessary to monitor the signal in the plant loop and insure 
that the system remains stable. With this information, the gain, K, 
may be adjusted so the system is on the verge of instability. With the 
gain as high sis practically possible because of stability reasons, the 
transfer function approximation of equation (1-4) is as accurate as pos- 
sible. The block diagram of a practical high-gain adaptive control sys- 
tem is shown in Figure 1-2. Here, the loop stability monitoring charac- 
teristics and the gain adjusting capabilities are included. 

The high-gain concept of adaptive control does have serious draw- 
backs, however. One of the major disadvantages of the high-gain approach 
is that a considerable amount of apriori information about the system 
must be known. For example, from a practical standpoint, in order to 
utilize the capabilities of the approach, the approximate value of gain 
where the roots of the system characteristic equation go into the right- 
half plane must be known. 

One of the first applications of the high-gain approach for adapt- 
ive control systems was the adaptive system for the horizontal stabiliz- 
ers on the X-15 aircraft [4]. The system block diagram, not including 
the reference model, for the roll axis is shown in Figure 1-3. As can be 
seen from the figure, the gain in the system is a function of a fixed 
gain, K^, and a variable stability augmentation system (SAS) or adaptive 
gain, K. 

The adaptive gain, K, was varied so as to provide optimum system 
performance throughout the various regions of dynamic pressure in which 
the X-15 would be operating. Adaptive operation was maintained at an 




Figure 1-2. Block diagram of practical high-gain adaptive control scheme. 










Figure 1-3. Roll axis block diagram for X-15 aircraft. 
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oscillation frequency of 4 hz. The various shaping networks were 
designed to compensate for effects such as structural bending modes and 
a resonant mode due to the mass unbalance of the stabilizers. This high- 
gain adaptive control system was successfully flight-tested with the X-15 
aircraft. With the adaptive system, the response to a pulse or step in- 
put in the roll and yaw axis was essentially critically damped whereas 
the pitch axis response to a pulse or step input had a slight overshoot. 

2. Optimal Adaptive Control Systems 
The optimal adaptive control method is, in general, the most complex 
of the adaptive control schemes. In the optimal adaptive approach, the 
adaptive action is determined in order to achieve a maximum or a minimum 
of some prespecified performance index whereas in other approaches such 
as the high-gain scheme, the adaptive action consists of attempting to 
match some prespecified system characteristics such as the system pole- 
zero locations. Thus, the optimal adaptive control method basically con- 
sists of solving some optimization problem. However, in order to solve 
the optimization problem, it is necessary to assume that the system param 
eters and system states are known. In general, for an adaptive control 
problem, these quantities are not completely known and plant identifica- 
tion and state estimation become an integral part of the problem. How- 
ever, this adds measurably to the complexity of the adaptive control 
problem. A general block diagram for an optimal adaptive control system 
is shown in Figure 1-4. 

For plant identification, correlation techniques may be used in 
order to obtain an approximation to the system inpulse response. The 




Figure 1-4. Block diagram for basic optimal adaptive control scheme. 
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input-output cross-correlation function, for a system with an 

impulse response, h(t), which is excited by a noise signal with autocor- 
relation, is given by the expression: 


R xy (T) 



R xx (t + t) h(t) dt 


(1-5) 


If the input is white noise or if the bandwidth of the input is consid- 
erably larger than the system bandwidth, the autocorrelation function may 
be represented as- an impulse and the input-output cross-correlation is 
given by 


RxyCr) - g(-t). (1-6) 

Under the assumption of ergodicity, the cross-correlation function may be 
approximated by a time average. One point of the impulse function may 
then be obtained for each value of delay, x, at which the input-output 
cross-correlation is performed. By operating a number of the input-out- 
put cross-correlators in parallel with delays of x, 2x, 3x, etc., a 
reasonable approximation to the system impulse response may be obtained. 

One technique for the solution of the state-estimation problem is 
with the methods discussed in Meditch [5 ] . Consider the system repre- 
sented by the relations 


x(t) = F (t) 

x(t) + G(t) w(t ) 

(1-7) 

z(t) = H(t) 

x(t) + v(t). 

(1-8) 
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where jc(t) is the system state, an n-vector, z.(t) is the measurement 
vector, an m-vector, and w(t) and v(t) are zero mean gaussian white noise 
vectors of dimension p and m, with covariance matrices Q(t) and R(t), 
respectively. F(t), G(t), and H(t) are matrices of dimension nxn, nxp, 
and mxn, respectively. A block diagram of this system is shown in Figure 
1-5. The problem of estimation may then be stated as follows: 

Given the measurement z(t), we wish to find an estimate of x(t) , 
which will be denoted as x(t). This estimate will be defined as an n- 
dimensional function, 4> > of the measurements. In equation form, this 
may be stated as: 


x » 4>[i(t)] (1-9) 

The filtered estimate for the system of Equation (II-7) and (II-8) , first 
solved by Kalman, is given by 

x = F(t) x + K(t) [z(t) - H(t) x] , (1-10) 

where K(t) is an nxm filter gain matrix given by 

K(t) = PH T (t ) R -1 (t) , (1-11) 

T “1 

where ( ) and ( ) denote transpose and inverse, respectively, and P 
is the covariance matrix of the filter estimation error and is the solu- 


tion of the matrix Riccati equation 




Figure 1-5. Block diagram of system for state estimation. 
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P = F(t) P + PF T (t) - PH T (t) R _1 (t) H(t) P + G(t) Q(t) G T (t) (1-12) 

The preceding methods for plant identification and for state estima- 
tion require a large amount of calculations and for large order systems, 
the computational requirements may be excessive. The delays introduced 
by the required computations may, in many instances, cause stability 
problems. In addition, the plant identification scheme requires an aux- 
iliary input to the system which consists of noise with a bandwidth much 
greater than the bandwidth of the system. This auxiliary input may, in 
many applications, be impractical. 

One example of an optimal adaptive scheme is that of Margolis [6]. 

In this scheme, identification is accomplished by having a "learning" 
model which is an analog of the system to be adapted. The model contains 
adjustable parameters which are used to force the model to dynamically 
track the system. The. same input signals are received by both the model 
and the plant and the difference in the plant and model outputs is used 
to determine the necessary parameter adjustments. The adjusted param- 
eters of the model are then used to compute the plant alterations nec- 
essary in order to provide minimization of the specified Performance 
Index. 


3 . Model-Reference Adaptive Control Systems 
The concept of model-reference adaptive control evolved at the Massa- 
chusetts Institute of Technology Instrumentation Laboratory [7]. It 
evolved from a research program to develop automatic flight control 
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systems capable of providing adequate control throughout a very wide 
operating range. The adaptive action is "closed-loop" and adaptation is 
performed based on normal operating inputs to the system. Hence, special 
test signals for disturbing the system are not required. A basic block 
diagram of a model-reference system is shown in Figure 1-6. 

In the model -ref erence concept, system performance is evaluated by 
comparing it with the performance of a reference model. The reference 
model is designed so that its output, when excited by the same input com- 
mands as to the system to be adapted, gives the desired response of the 
system. The response error is formed by taking the difference between 
the output of the reference model and the output of the plant. The adapt- 
ive mechanism then determines the adaption necessary so that the system 
response closely approximates that of the model. 

Two of the approaches proposed in order to achieve the required 
adaptation for model-reference adaptive control systems are those of 
Osburn [8] and Dressier [9]. In the work by Osburn, the basic configura- 
tion is as shown in Figure 1-6. The plant is assumed to have k adaptive 
parameters. The performance criterion, L, is an even function of the k 
adaptive parameters. L is then used in order to determine how the adapt- 
ive parameters should be adjusted in order to achieve the desired system 
performance. The adjustments of the adaptive parameters are determined 
in the following manner. The performance criterion, L, which is a func- 
tion of the k adaptive parameters is viewed as a hyperplane in the k- 
dimensional adaptive parameter space. The objective then is to find the 
required adaptive parameter values so that the performance criterion is 



Adaptive 


Plant 


Figure I- 


Controller 


, Block diagram of basic model-reference ; 



ive control scheme 
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minimized. The partial derivatives of the performance criterion with 
respect to the various adaptive parameters are obtained. Each parameter 
is then adjusted at a rate proportional to the partial derivative of L 
with respect to that parameter. The adaption then proceeds to an extre- 
mum along the path of steepest descent. The particular performance cri- 
terion selected by Osburn is 



( 1 - 13 ) 


The interval [tj_, 1 2 3 must be of sufficient length so as to include a 
large portion of the system response due to an input at time t-^. The 
parameter adjustment of P^, the k th adaptive parameter, is given by: 



( 1 - 14 ) 


where K is an adaptive gain constant which determines the magnitude of 
the adjustment. 

The selection of a performance criterion for use with the method of 
steepest ascent or descent is very critical. For example, if the hyper- 
plane represented by the performance criterion has several points at 
which the gradient is zero, but at some of these points, the performance 
criterion does not assume its absolute minimum or maximum value, then 
the adaptive parameters may not be adjusted to the values necessary to 
attain the desired system characteristics. Also, the complexity 
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associated with the generation of the necessary partial derivatives is a 
distinct disadvantage of this method. 

Dressier approaches the model-reference adaptive control problem 
from the state-space point of view. The model system is assumed to be 
of the form 


Sm = V 5m + Bn u 


( 1 - 15 ) 


where Xm is an n*-* 1 order model state vector, ia is an r-dimensional in- 
put vector, and Ajjj and Bjj are matrices of order nxn and nxr, respect- 
ively. The plant is assumed to be represented by: 

ip = Ap 5? + B p u (1-16) 

where Xp is an n fc ^ order plant state vector, u is the same input as in 
the model, and Ap and Bp are nxn and nxr matrices, respectively. In 
order to obtain analytically the explicit functional relationship be- 
tween the response error and the adaptive parameters it is assumed that 
the matrices Ap and Bp may be decomposed as follows: 

Ap = Ajjj + ^ ^ ^ 

B p = Bm + 6B 6 

The matrices 6A^ and 6Bg contain the adaptive parameters and are consid- 
ered as perturbations of the plant matrices from the model matrices. 
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With these assumptions, an explicit relationship for the response 
error may be derived using the method of successive approximations for 
the solution of the necessary differential equations. In order to obtain 
a measure of the change in the response error due to a change in the 
adaptive parameters, the incremental response error is defined as 

Ae(t) ^ e(t + At) - e(t) (1-19) 


where At is chosen sufficiently small so that any incremental response 
error occurring in At time is due only to the change caused by the adjust- 
ment of the adaptive parameters. 

The basic premise in Dressier’ s solution to the adaptive control 
problem may be stated thusly: If at some time tj_, the response error is 

not zero, the adaptive parameters will be adjusted so as to cause the 
magnitude of the response error to be decreased for t > t-^. In equation 
form, the design criterion may be stated as: 


If 

then 

e(t x ) < 0 

Ae(t! + At) 

e(ti) > 0 

Ae(t 1 + At) 

eCt x ) = 0 

Ae(t x + At) 


> 0 

< 0 and 

= 0 . ( 1 - 20 ) 


Dressier shows that this design criterion may be satisfied if the adapt- 
ive parameter rates are chosen by the relationships: 
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a(t) = k x Xjjj(t) e (t) (1-21) 

b(t) = V -2 u(t) e(t) (1-22) 

where a and b are elements of Ap and B^, respectively and k^ and k 2 are 
adaptive gain constants. 

It is obvious from comparing equations (11-14) , (11-21) , and (11-22) 
that the adaptation relationships obtained by Dressier would be much 
simpler to implement than those obtained by Osbum. However, in both of 
these techniques, the stability of the adaptive system is not considered 
in the design relationships. 

B. Purpose of Present Research 

It is the purpose of the present research to obtain adaption rela- 
tionships for model-reference adaptive control systems which, by utiliza- 
tion of the stability theorems of Liapunov, incorporate stability consid- 
erations of the adaptive system into the basic design equations. Adap- 
tion relationships are derived from both time domain and frequency domain 
considerations. An investigation is also made into the use of sensiti- 
ity coefficients in connection with the design of model-reference adapt- 
ive control systems. 

Specifically, Chapter II contains a detailed discussion of the de- 
termination of stability via Liapunov's direct method. In Chapter III, 
the adaption relationships are derived for the design of model-refer- 
ence control systems using Liapunov's direct method. The design proce- 
dure is developed for a time-domain representation of the system. In 
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Chapter IV, the second method of Liapunov is used to design feedback fil- 
ters and pre-filters to provide the necessary adaption. This procedure 
is based on frequency-domain considerations. In Chapter V, the use of 
sensitivity coefficients in the design of model-reference adaptive con- 
trol systems is studied. Chapter VI contains a comparison of the various 
adaption schemes developed and conclusions regarding their use. 



II. LIAPUNOV'S DIRECT METHOD 


Since the use of Liapunov's direct method is vital to the design 
techniques developed in the present research, it is felt that a chapter 
elucidating the second method is necessary for completeness. The 
material contained in this chapter essentially comes from the author's 
class notes and [10], [11], and [12]. 

A. Historical Background 

The direct method of Liapunov was introduced by the Russian math- 
ematician A. M. Liapunov in a dissertation in 1892. The method is a 
general procedure for determining the stability of ordinary differential 
equations. It is of very broad scope in that it is applicable to auton- 
omous or nonautonomous and to linear or nonlinear ordinary differential 
equations. In the literature, the direct method is sometimes referred 
to as Liapunov's second method. Liapunov classified the stability 
analysis techniques for ordinary differential equations as belonging to 
one of two methods. The indirect, or first method, requires the 
solution to the differential equations under investigation. The direct, 
or second method, which is of primary interest, does not require the 
solution of the differential equations under investigation, but deals 
with stability criteria which can be applied directly to these equations. 
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B. Liapunov Stability 

Before discussing the determination of stability via Liapunov's 
direct method, it is necessary to properly and precisely define the 
concept of stability. In a linear, autonomous system, there will exist 
only one equilibrium state. If all system trajectories approach this 
equilibrium state as time approaches infinity the system is said to be 
stable. If all system trajectories not initially at the equilibrium 
state approach infinity as time approaches infinity, then the system is 
said to be unstable. An exception to these definitions is the case 
where the system has roots which are purely imaginary. For this case, 
if the system is not initially at the equilibrium state, the system will 
oscillate for all time. The stability of a linear system is indepen- 
dent of the magnitude of the initial conditions and, in addition, the 
output of the system is bounded for any bounded input. Unfortunately, 
for nonlinear systems, there are various degrees or levels of stability. 
There are at least 3 basic differences in the concept of stability for 
a nonlinear system. These are: (1) A nonlinear system may have several 
equilibrium states. Therefore, in general, it is necessary to speak of 
the stability relative to an equilibrium state rather than stability of 
the system as was done in the linear case; (2) In the nonlinear system 
stability of an equilibrium state does not imply stability of the over- 
all state space. The notions of local stability and global stability 
must be considered separately; (3) Even in the case of local stability, 
the concepts of boundedness of the system state trajectories and the 



24 


asymptoticity of the system state trajectories are involved. Boundedness 
of a system state trajectory refers to the property that a system state 
which is initially in some suitably restricted region, will never leave 
another well-defined region. The concept of asymptoticity refers to the 
property that all system state trajectories will approach the equilibrium 
state under investigation as time approaches infinity. 

The basic idea of stability as formulated by Liapunov is of the 
same notion as the boundedness property discussed above. In the fol- 
lowing, || || denotes the Euclidean norm. The definition for 

Liapunov stability is as follows : 

Definition II-l . An equilibrium state, Xe, of an autonomous dynamic 
system is stable in the sense of Liapunov if for e > 0, there exists 
a 6 > 0 such that if | |xq - x g | | <6, then | |x(t) - x g | | < e for all 
t > t 0 . 

The concept of Liapunov stability is illustrated in Figure II-l. The 
definition for not being Liapunov stable may be stated thusly: 

Definition II-2 . An equilibrium state, x e , is not stable in the sense 
of Liapunov if there exists an e > 0 such that if for all 5 > 0, there 
exists an initial state x g when I I x q - x | | <6 such that | |x(t) - x £ | | 

> e for some t > tg. 


Asymptotic stability may be defined as follows: 
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Definition II-3. An equilibrium state, x e , is asymptotically stable if 
(1) the equilibrium state is stable, and (2) there exists a 6 a > 0 such 
that if | | xq - x e | | < 6 a , then the system state trajectory approaches x e 
as time approaches infinity. 

An illustration of asymptotic stability is shown in Figure II-2. 

Definition II-4 . A system is not asymptotically stable if (1) the 
equilibrium state is not stable, or (2) if 6 >0, there exists an 
initial state Xq where II x q “ x e I I < & a such that the system state 
trajectory does not approach x e as time approaches infinity. 

These concepts of stability are local in nature, i.e., they apply 
to the stability of a system in a region about the equilibrium state. 

In addition, the notion of not being Liapunov stable does not imply that 
the state trajectory will stray arbitrarily far from the equilibrium 
state. 

C. Sign Definiteness of Scalar Functions 

For convenience in the discussion of the Liapunov stability theorems 
in the following section, the concept of sign definiteness of a scalar 
function will be briefly discussed. Also, a particular class of scalar 
functions, the quadratic form, will be introduced. 

The idea of sign definiteness of a scalar function of an n-dimen- 
sional variable x is an extension of the idea of a scalar function of a 
single variable. For example, a scalar function f (x) is positive on the 
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interval a £ x £ b if f(x) > 0 for all x in this interval. Likewise, a 
function is negative on the interval a £ x £ b if f (x) < 0 for all x 
in this interval. For the case of a scalar function of an n-dimensional 
variable x, the sign definiteness is dependent on an n-dimensional 
region. 


Definition 

II-5. 

A scalar function V(x), is positive definite in the 

region | |x| 

1 1 c 

if (1) for all nonzero x in 

] | x | | < C, V(x) > 0, and 

(2) V(0) = 

0. 



Definition 

II-6. 

A scalar function, V(x), is 

negative definite in the 

region | |x| 

1 1 c 

if (1) for all nonzero x in 

| | x| | < C, V(x) < 0, and 

(2) V(0) « 

0. 



Definition 

II-7. 

A scalar function, V(x), is 

positive-semidef inite in 

the region 

11*11 

< C if (1) for all x in | |x| 

| £ C, V(x) £ 0, and (2) 

< 

o 

ii 

o 




Definition 

II-8. 

A scalar function, V(x), is 

negative-semidef inite in 

the region 

11*11 

^ C if (1) for all x in | |x| 

£ C, V(x) £ 0, and (2) 

o 

ii 

o 

> 




Definition 

II-9. 

A scalar function, V(x), is 

indefinite if for C > 0, 


there exists a value of x in | |x| | £ C such that V(x) is positive and a 
value of x is | |x| | £ C such that V(x) is negative. 

The next question might be that given a scalar function V(x), how 
does one use the previous definitions to ascertain the sign definiteness 
of the scalar function. In general, there is no straight forward 
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approach for determining the sign definiteness of a given scalar func- 
tion. This fact severely restricts the potential usefulness of the 
stability theorems of Liapunov. However, there is one particular form 
of scalar function for which there exists a technique for determining 
its sign definiteness. Such a scalar function is the quadratic function, 
which may be written as: 

n n 

V(x) = ; T k..x.x. where 

i-i A ij 1 j 

, i, j = 1,..., n are constants. This scalar function involves terms 
only of second degree in x.^ and x j . The scalar function, V(x) may also 
be written as: 

T 

V(x) = x Qx, where 


Q is a constant symmetric nxn matrix. A method of determining the sign 
definiteness of this function is by the use of Sylvester's theorem. 

Theorem II-l - Sylvester's Theorem . A quadratic scalar function, V(x) , 
is positive definite if and only if each of the quantities 


det [q n ]. 

det 

«11 

q i2 


q il ■ 

q 1 2 

q 1 3 


q 12 

q 22 

det 

q 1 2 

q 22 

q 23 






9, , 

q „ 

q 






13 

23 

33 
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are greater than zero. 

If any of the above determinants fails to be positive by being 
equal to zero, then the scalar function is positive semidefinite. A 
matrix Q is negative definite or negative semidefinite if the matrix 
-Q is positive definite or positive semidefinite, respectively. 

D. Liapunov Stability Theorems . 

The basis of Liapunov's direct method may be considered as a 
generalization of the energy concepts for mechanical systems. For 
example, a mechanical system is stable and tending towards an equilib- 
rium state if the total energy of the system is decreasing. This basic 
idea, extended to n-dimensions , may be used to determine if an equilib- 
rium state of a system is asymptotically stable, stable in the sense 
of Liapunov or unstable. Proofs of these theorems are given in [10]. 

Theorem II-2 - Liapunov's First Stability Theorem . An equilibrium 
state, x e , of a system is stable in the sense of Liapunov if (1) there 
exists a scalar function, V(x) , which is continuous and has continuous 
first partial derivatives in some region R about the equilibrium 
state, (2) V(x) is positive definite in the region R and, (3) the time 
derivative of the scalar function, V(x) , evaluated along the trajec- 
tories of the system under investigation, is negative semidefinite in 


the region R. 
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Theorem II-3 - Liapunov's Second Stability Theorem . An equilibrium 
state, x e , of a system is asymptotically stable if (1) there exists a 
scalar function, V(x) , which is continuous and has continuous first 
partial derivatives in some region R about the equilibrium state, (2) 
V(x) is positive definite in the region R, and (3) the time derivative 
of the scalar function, V(x) , evaluated along the trajectories of the 
system under investigation, is negative definite in the region R. 

Theorem II-4 . An equilibrium state, x , of a system is asymptotically 

e 

stable if (1) the equilibrium state is Liapunov stable and (2) the 
curve V = 0 is not a system trajectory. 

The preceding theorems provide only sufficient conditions for deter 
mining the stability of an equilibrium state. Thus, for a given system, 
if a scalar function that satisfies the conditions of the stability 
theorems cannot be found, it does not mean that the equilibrium state 
is unstable. We have only failed to establish the stability of the 
equilibrium state. The following theorems may be used to establish the 
instability of an equilibrium state. 

Theorem II-5 - Liapunov's First Instability Theorem . An equilibrium 
state, Xg , of a system is unstable if (1) there exists a scalar function 
V(x), which is continuous and has continuous first partial derivatives 
in some region R about the equilibrium state, (2) the time derivative 
of the scalar function, V(x) , evaluated along the trajectories of the 
system under investigation, is positive definite, and (3) the scalar 
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function V(x) is indefinite, positive semidef inite , or positive definite 
in a region, R, arbitrarily near the equilibrium state. 

Theorem II-6 - Liapunov's Second Instability Theorem . An equilibrium 
state of a system, x g , is unstable if (1) there exists a scalar func- 
tion, V(x) , which is continuous and has continuous first partial deriv- 
atives in some region R about the equilibrium state, (2) the time 
derivative of the scalar function, V(x) , evaluated along the trajec- 
tories of the system under investigation, is of the form 

V(x) = AV(x) + Vi(x) where 

A > 0 and V-j^Cx) is positive semidef inite in the region R, and (3) the 
scalar function V(x) is indefinite, positive semidef inite , or positive 
definite in the region, R, arbitrarily near the equilibrium state. 

In order to illustrate the use of Liapunov's stability theorems, 
let us consider the stability of the equilibrium states of Van der Pol's 
equation. 



„ 2 x dx 

+ y(x -1) — + x = 0 
dt 


(II-l) 


where y is an arbitrary constant. In state equation form, this may be 


written as: 
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The only equilibrium state of the system is obviously, x^ = ^ = 
Investigation of equation (II-2) shows that for y > 0 a stable limit 
cycle is indicated. This is, indeed, the case. The limit-cycle bound- 
aries are shown in Figure II-3 for a value of y = 1. For y <0, an 
unstable limit cycle is indicated and this is exemplified in Figure II-4 
by two system trajectories, one inside the limit-cycle boundaries and 
one outside. Thus, for y > 0, the equilibrium state is unstable in the 
sense of Liapunov and for y < 0, the equilibrium state is asymptotically 
stable. 

In order to show this using Liapunov's stability theorems, consider 
first the case y = 1. The state equations may be written as: 


X 2 = -x^ - (x^-l)x2 (II-3) 

As a scalar function, V(x) , select 

V(x) = x^(3/2-l/4x^) + X 2 ^ - x i x 2 


(II-4) 
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This function is positive definite for < 5. The time derivative of 
equation II-4 evaluated along the system trajectories is: 

V(x) = x^ + x 2 2 (1-2x 1 2 ) (II-5) 

Equation II-5 is positive definite for x^ less than 1/2. Therefore, 
from Theorem II-5, the equilibrium state is unstable. 

For the case p = -1, the state equations may be written as: 


X 1 = X 2 


* 2 = -x 1 + (x -l)x 2 


(II-6) 


Again, the single equilibrium state of the system is x^ = x 2 = 0. For 
this case, select V(x) to be: 


V(x) = 1/2 x^ + + l/4x^ 


(H-7) 


V(x) , evaluated along the system trajectories is given by: 


V(x) = -Xj 2 - 3x 2 ^ + 2x^ 


2 x 2 


(II-8) 


Thus, the conditions of Theorem II-3 are satisfied for x^ less than 3/2 


and the equilibrium state is asymptotically stable. 
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F,. Application of Liapunov's Direct Method to Model- Reference Adaptive 
Control Systems . 

The basic idea in the application of Liapunov's direct method for 
the design of model-reference adaptive control systems is to design 
the system adaption in such a manner that the response error (model 
output minus plant output) will be asymptotically stable. If by using 
Liapunov's direct method it can be shown that the response error is 
asymptotically stable, then it follows that the plant will track the 
model. 

The response error, in equation form, is given by: 


e(t) = x m (t) - x p (t) 


(II-9) 


If the adaption is designed so that the response error is asymptotically 
stable and the model is assumed asymptotically stable, then 


limit e(t) = limit x m (t) - limit x p (t) 
t -*■ 00 0° 


( 11 - 10 ) 


Since limit e(t) = limit x^t) = 0, then 


t 00 


t -* 00 


limit x (t) = 0 

P (11-11) 

t -► oo 


and the plant will adapt so as to track the model. 


HI. TIME-DOMAIN MODEL REFERENCE ADAPTIVE CONTROL SYSTEM DESIGN 


This chapter presents the results of the present research in the 
area of time-domain design of model-reference adaptive control systems 
using Liapunov's direct method. The time-varying model-reference adaptive 
problem is formulated precisely and the adaption technique is derived 
analytically. The inclusion of several positive semidefinite terms into 
a Liapunov function results in an adaptation rule which is a function of 
the response error, the input, the plant states, and the derivative and 
integral of these quantities. The design technique, as well as being 
applicable to a class of time-varying systems is also shown to be 
applicable, with certain assumptions, to a class of non-linear adaptive 
systems. Simulation results of a model of the National Aeronautics and 
Space Administration's Space Shuttle vehicle show that the adaptation 
technique provides good convergence for the adaptive parameters and that 
the response error is greatly reduced as compared to the non-adapted 
system. 

A. Problem Formulation 

The time-varying adaptive control problem considered is assumed to 
be described by the state equations: 

Xp(t) = A p (t)Xp(t) + B p (t)u(t) (III-l) 
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where Xp(t) is 311 n-vector, ,u(t) is an r-vector, and Ap(t) and Bp(t) are 
n x n and n x r matrices, respectively. The elements of Ap(t) and Bp(t) 
consist, in general, of unknown, time-varying adjustable parameters. Each 
element of the Ap and Bp matrices is assumed to be of the form: 


4j(t> 


- c ± j (t) + K ± j (t) 


(III-2) 


bij (t) " 


b b 

Cij (t) + ^(t) 


sl b 

where (t) and (t) are the adaption parameters, and in general, 

q b 

c^ (t) and c.^ (t) are time varying unknown values. One basic assump- 
tion, which is necessary for mathematical rigor, will now be made 


concerning the elements of the A p and B p matrices. The assumption is 
that the time rate of change of the unknown portion of the plant para- 


.a 


.b 


meters, i.e., c-^j (t) and c^j (t) , may be considered negligible as corn- 


ea 


pared to the time rate of change of the adaption parameters , Kj_j (t) and 


Ky (t) • 


The model control system is assumed to be of the form: 


= 


A n&n (t) + B n£ (t) 


(III-3) 


where x^t) 311 n-vector, va is an r-vector, and Ajj and B m are n x n 
and n x r constant matrices, respectively. 
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This is basically the same system as in [13] and [14] except a time- 
varying plant is considered here. The response error in the model- 
reference scheme is given by: 

e(t) = ^(t) “ 2£p C £ > (III-4) 

The error state equation may then be derived from Equations (III-l) , 
(III-3) , and (III-4) as: 

e(t) = A^Ct) + A(t)Xp(t) + B(t)u(t) (HI-5) 

where A(t) = An, - Ap(t) and B(t) = Bn, - B p (t). 

The reference model output, x^t) , corresponds to the desired out- 
put of the adaptive control system when subjected to the input ii(t) . The 

a b 

design objective then is to adjust the parameters Ky (t) and K-jj (t) so 
that Xp(t) closely approximates Xjjj(t) regardless of plant parameter vari- 
ations . 

B. Derivation of Adaption Rule 

The first step in the derivation of the adaption rule is to select 
a Liapunov function which is a quadratic form of the error plus several 
positive semidefinite terms. The positive semidefinite terms will be a 
function of the error states, the plant states, the inputs, and the 
adaption parameters. For convenience in notation, the dependence on time 
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of the various quantities will be denoted explicitly. 
The Liapunov function selected is: 


V ' 6 Qe \ih % + 


ij dt 


+ l, l r 1 - «•« + 5 « , , e kiki“j 


U ti v 

i=lj=l Y 




k=l 




(in-6) 


Q is a symmetric positive-definite matrix which will be determined later 
a„ and b^ are elements of the A and B matrices, respectively, a^_. and 
Y-jj are constants > 0, and , P^j > ant * a ij are constants >.0. 

This Liapunov function differs considerably from that of [14] as the 
basic form has been modified by the addition of the terms and cross- 
product terms associated with the coefficients and . With the 
inclusion of these terms, the adaption parameters become a function of 
the integral and the derivative of the error as well as the error itself 
The time derivative of Equation (III-6) , term by term, is 


V = e T [A m Q + QAje + 2e T QAx p + 2e T QBu 


n a. .a. . 

+ * I 

i.j-l 
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n 3 . . a n 

+ 2 ijl 1 “ij 

+ 2 i,jL ^ a±i ^ [Ji ekqkiXp:) ] 

+ 2 ijl ^ dF [ 

+ 2 i,Ji «ij a « a?[ Ji ek<lklX pj] 

& [ JAV^] 


n 3 p 

+ 2 l * ■ ’ 1J { 
i.j-l °iJ 


n 3 . . P . n 
±2 ii 


+ 2 I — 2 1 T e q x . 

i.j^l a, . ks»l k M ki pj dfc 2 


iJ 


+ 2 1, dt [ k = 1 e k q ki X P j J 

2 

+ 2 i,Ji rf dt [k=i ek<lkiX pj ] ;^[ k I 1 e k q ki*pjj 


[il e k q kl*pj] 


1J 

n n 


u U li M 

2 1 Jl P i3 Ji ekqkiXpj Ji ekqkiXpJ J 


n r b b . , 

+ 2 I I 

i=lj=l T ij 
• 

n r 6 . b . n 

+ 2 l l -^1 


+ 2 


l e k q ki u i 
i=lj=l 'ij k=l ^ 2 

Y v b *j d f S 1 

i-lj-1 V dt Lk=i ekqkiUj J 
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n r 6 b , _ n 

+ 2 ll ^ ^ A-T I e, q, . u.l 

i=!j=i y±i * U=i k kl 3 


+ 2 


+ 2 


+ 2 


n r a. . b. . ,2 r n 

d? [ Ji e k q k iU j] 

n r <5 . . ° . , r n T 9 

n r 6. . a. . n ,2r n 1 


n r & . . n 

+ 2 l l^T 1 l e k^ki u j dt I l e k qfci u j 
i=lj=l T ij k=l J 1 J 


n r a n ,, 

+ 2 I I 7^ dt 

i=lj=l Y ij 


+ 2 


Ui^-J ^ Ui w i 

Ll' 4 ^ 77 [Ji ek,ki “ j ] 


(HI-7) 


In order to prove that the response error is asymptotically stable, it is 

• • 

necessary to choose a^ and b^ so that the time derivative of the 
Liapunov function is negative definite. Now, 


e QAXp = 


(e l1ll + e 2’21 + ••• + Vnl>' (a ll x pl + a 12 x p2 + •" + a l„ x p„ ) + 


(e l«12 + e 2^22 + ••• + e n’2n> ' <a 21 x pl + a 22 x pn + "• + a 2n x pn ) + 


pn 


P n 
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+ (e,q, + e 0 q~ + ••• + e a ) • (a ,x,+a 0 x 0 +***+a x ) 

l^ln 2 n 2n n^nn nl pi n2 p2 nn prr 


P n 


n n n 

~ ) / / a . . e, q, . x . 

i=l j=l k=l 1J k kl 


and 


T 

e QBu = 


( e l q ll + e 2 q 21 + *•* + e n q nl^ * ^ b ll u l + b 12 u 2 + *** + b i r u r ) + 
(e l q 12 + e 2 q 22 + *•• + e n q n2 ),(b 21 u l + b 22 u 2 + •** + ^rV + 


+ < e l q ln + e 2 q 2n + * * * + e n q nn> * ( b nl u l + bn2 u 2 + * * * + b nr u r > 


n r n 


■Ji jk Ji bijekqtlU ^ 


Let the parameters a„ and b„, which are directly related to the adapt- 
tion parameters, be of the form: 


a ij 


n r n 

“ij k = 1 ®k q ki X pj _P ij dt [jJ-j^k^pjJ 

[ Ji ekqkiX ^] 


1J dt 2 


(III-8) 
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n 


[ n 

T e, q. . x . 
k £ x k 4 ki pj_ 


' 0l J dt 2 


[ X Wl ] 


(III-9) 


Substituting the above values for a^ and 6^.. into Equation (III-7) , and 
collecting terms, V becomes: 


V = e T (A^Q + QA m )e -2 J 6 ±j [ I e k q kiXpj "| 

i,j=l L k=l J 

- 2 lk s * U w J ! 


(III-10) 


This cancellation of terms in the expression of V by the substitution of 
. . n a.. A., 

a., and b.. is accomplished as exemplified below. The term 2 7 — ^ 1 

1J 1J i,j=l °ij 

upon substitution of a^^ from Equation (III-8) becomes : 


n n 

-2 J a. . 7 e, q, .x . 
L it L k^ki pi 
i,j=l k=l 




5 a ij P ij d2 “ 

“ij dt 2 k=l 6 k q ki- X pj 


z&- 
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Thus, these terms will cancel with terms 2, 6, and 8 of Equation (III-7). 
The remaining terms may be eliminated in a similar manner. Since, by 
assumption, and are greater than or equal 0, it is necessary only 
to show that the first term of Equation (III-10) is negative definite in 
order to prove that the response error is asymptotically stable. 

It is known [10] that if the matrix is a stable matrix, there 
exists a unique symmetric positive-definite matrix Q, which satisfies the 
equation 

T 

A Q + QA = -C (III-ll) 

m m 


where C is any symmetric positive-definite matrix. Thus, for any posi- 
tive-definite C, V is a positive-definite quadratic function of the re- 
ponse error and V is a negative-definite quadratic function of the response 
error. Therefore, from Theorem II-3, the error is asymptotically stable 

and the plant output will track the model output. 

.a .b 


The adaption parameters rates , 
the relationships 


K. 


ij 


and may be determined from 


m 

a . . = a. . 

ij 13 

P 

- a. . 
13 

•? 

ii 

a 

- c. . (t) 
ij 

a 

- K. . 
13 

(t) 

m 

b. . = b, . 
iJ ij 

- b ij 

m 

= b. . 
ij 

b 

- c. . (t) 
13 

b 

- K. . 
13 

(t) 
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Taking the time derivative of a^ and b^ and invoking the assumption 
that ctj (t) and c^(t) are negligible as compared to Kfj(t) and (t) , 
respectively, the adaptive parameter rates are given by the expression: 


K^(t) = -a.jj (t) 

.b 

K.jCt) = -b ± (t) (III-12) 


Integrating Equation 12, the adaption parameters are: 


a 




+ P 


ij 


b 

K ij - y±i 


+ a 


ij 


/[j^ki'pj]^ + PiJ j^ki^pj 
tQ 

dt l_k=i ekqklXpj ] + K± J (to) 


f [ji ekqklUj j d<f> + 6i i ^ ®k q ki u j 

^i e k q ki u j 


o 

d_ 

dt 


- 

+ K ij^o> 

- 


(III-13) 


(III-14) 


Equations (III-13) and (III-14) then give the general relationships for 
the adaptive plant parameters. 
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C. Application of Design Technique 

In order to illustrate the application of the design technique, a 
model of the National Aeronautics and Space Administration's Space Shuttle 
vehicle is used. The design technique is applied first to a model with 
linear characteristics and then to a model with nonlinear characteris- 
tics. A linear simulation study was necessary since by using modulation 
techniques, virtually linear characteristics in the Space Shuttle vehi- 
cle may be obtained [15]. Simulation studies were also made in order to 
determine the effect on the adaptation caused by wind gust disturbances 
on the system. The dynamic equations used for the Space Shuttle vehicle 
is assumed to have one bending mode in addition to the rotational mode. 

In transfer function notation, the dynamic equations for the plant and 
model may be represented as: 

Vs) _ s 

U(s) s 2 + .2s + 4 

<(> (s) 1 

_E = _ 

U(s) s 2 

n (s) s 

_m_/ _ 

U(s) s 2 + 2s + 4 

V(s) 1 


U(s) 


s 2 + 1.414s + 1 


(III-15) 



49 


In state equation form, the plant equations may be represented as: 
x, - x 

lp 2p 

x 2p = -4.x lp - .2x 2p + u 

X- = X. + u 

3p 4p 

i, = u (III-16) 


where x^ p = n. x 2p = n, X3 p = 4> + <j>, and x^ p = <j>. The matrices Ap(t) 
and Bp (t) , from Equation (III-l) are 


0 10 0 

-4. -.2 0 0 


0 0 0 


1 


and 


0 0 0 0 


B = 


[0 


1 


1 


1 ] 


T 


For simulation purposes, it is necessary to assume specific values for 
the elements of the Ap and B p matrices. The design technique does not, 
however, require the value of these elements for its implementation. 

The rotational mode consists only of an inertial load and the bending 
mode has a damping ratio of .05 with an undamped natural frequency of 
2. rad/sec. It is assumed that all states are available. 
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The model response chosen for the adapted plant in state equation 
form is : 

• 

x, = 

lm 2m 

x 2m = -4,x lm " 2 ' x 2m + u 

x 3m = ~ x 3m + • 586x 4m + u 

x 4m = " x 3m " - 414x 4m + u (HI-17) 

The matrices ^ and B ffl of Equation (III-3) are: 

10 0 
2 . 0 0 
0 - 1 . 

0 - 1 . 

B m = [0 1 1 1] T 

For the bending mode characteristics, the model has a damping ratio of 
.5 and an undamped natural frequency of 2. rad/sec. The rotational 
mode model has a damping ratio of .707 and an undamped natural frequency 
of 1 rad/sec. The parameters selected for adaption are the damping 
ratio of the bending mode and the damping ratio and natural frequency 
of the rotational mode. 
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In Equation (III-ll) , a solution for the matrix Q may be obtained 
with the selection of a positive-definite matrix C. 

Selecting the C matrix as : 



The Q matrix may be determined as: 




(III-19) 
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K 34 " 




(3 - e 3 x p4 +e 4 X p4 )d7r 


+ B 34 (3.e 3 x p4 +e 4 x p4 ) + p 34 — (3.e 3 x p4 +e 4 x p4 ) 


K 


43 


' “43 /< 


< e 3 x p3 +2 - e 4 x p3 )d7T 


+ 6 43 (e 3 x p3 +2.e 4 x p3 ) + P 43dt ( e 3 x p 3 +2 • e 4 x p 3^ 


K 


44 


- / 


(e 3 x p4 +2 * e 4 x p4 )d11 


+ B 44 (e 3 x p4 +2 ‘ e 4 x p4 ) + p 44di‘ (e 3 x p4 +2 * e 4 x P 4 ) 


(III- 20) 


(III-21) 


(III-22) 


These adaption equations were implemented in a digital computer program 
utilizing the Continuous System Modeling Program (CSMP) . For the linear 
case, two system inputs were investigated, the first being a sine wave 
and the second a step. Figure III-l shows the bending response of the 
unadapted plant, the adapted plant, and the model response for a sine 
wave input. The gains » $22’ and p 22 are 5., and 5., respec- 

tively. Figure III-2 shows the bending response for the unadapted 
plant, the adapted plant, and the model with a step input to the system. 
The gains <* 22 » & 22 » an< * p 22 are the same as in the previous case. Figure 
III-3 shows a plot of the response error for a sine wave input to the 
system for 2 values of p 3 2 * Figure III-3 illustrates that the derivative 
term of Equation (III-17) causes a significant reduction in the maximum 




Figure III-l. Bending mode responses of model, adapted plant, and 
unadapted plant, sine wave input. 


Bend 





Figure III-2. Bending mode responses of model, adapted plant, 
and unadapted plant, step input. 
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value of the response error. This is particularly significant because 
the smaller the response error the better the adaption is being accom- 
plished which means that the plant is more accurately tracking the model. 

Figures III-4 and III-5 show the rotational position and velocity 

responses, respectively, of the unadapted plant, the adapted plant and 

the model. For Figures III-4 and III-5, the input is a sine wave. For 

these figures, the adaptive gains are ot^ = = 6., B33 = 

0,, = = 6 // = 3 *» and P-j-j = P,, = P,, = P,, = * 2 * Figures III-6 and 

34 43 44 33 34 43 44 

III-7 show the unadapted plant response, the adapted plant response, and 
the model rotational position and velocity responses for a step input to 
the system. The adaptive gains are the same as in Figures III-4 and III- 
5. As can be seen from these figures, the adaption is quite rapid and 
the plant tracks the model very accurately for either of the inputs. 
Figure III-8 shows the rotational position response error of the adapted 
plant for two values of the coefficient of the derivative term in 
Equations (III- 18) , (III-19) , (III- 20) , and (III-21). As can be seen 
from the figure, the use of the derivative term significantly reduces the 
maximum value of the response error. The integral of the square of the 
bending response error and the rotational position response error were 
calculated using the values of p£ 2 » p 33 » p 34» p 43* p 44 8* ven above. 

The results are given in Table 1. As can be seen from the table, using 
the derivative term of Equations (III-17), (III-18) , (III-19) , (III-20) , 
and (III-21) , also leads to a reduction in the integral of the square 
of the response error. 




Figure III-4. 


Rotational position responses of model, adapted plant, 
and unadapted plant, sine wave input. 




Figure III-5. 


Rotational velocity responses of model, adapted plant, 
and unadapted plant, sine wave input. 






Rotational Velocity, deg. /sec. xlO 



Figure III-7. Rotational velocity responses of model, adapted plant, 
and unadapted plant, step input. 



Figure III-8. Rotational position response error curves for sine wave input. 
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The adaptive design technique developed in this chapter is appli- 
cable to plants with time-varying parameters. To illustrate this, 
simulation studies were made with the plant parameter &22 varying linearly 
from 0 to -.2 and with the plant parameter a ^ varying linearly from 1. 
to .6 in 5. seconds. Figures III-9 and III-10 show the bending mode 
response of the unadapted plant, the adapted plant, and the model for a 
sine and a step input, respectively. As indicated by the figures, the 
adaption is rapid and the response error is very small. Figures III-ll 
and III-12 show the unadapted plant response, the adapted plant response, 
and the model response of the rotational position and rotational velocity 
for a sine wave input to the system and with the parameter a^ varying 
as noted above. As can be seen in both Figures III-ll and III-12, the 
response error is quite small and the adaption is rapid. Moreover, in 
Figure III-12, the scale is such that in order to show the unadapted plant 
response, the adapted plant and model response are virtually indistin- 
guishable. Figure III-13 is thus included and shows the response error 
for the rotational velocity as a function of time. The figure shows that 
the adaption is rapid and that the plant tracks the model after a rela- 
tively short time. Figures III-14 and III-15 show the unadapted plant 
response, the adapted plant response, and the model response for the 
time-varying system with a step input. As in the case of the sine wave 
input to the system, the adaption is rapid and the plant tracks the 
model in a satisfactory manner. 

In general, a control system may be considered as having two inputs: 
the first being a control or command input which may, in general, be 



Time, Seconds 
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Figure III-9 . Bending mode responses of model, adapted plant, and 

unadapted plant, sine wave input, time-varying parameters 





Figure III-10. Bending mode responses of model, adapted plant, and 
unadapted plant, step input, time-varying parameters 
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Figure III-13. Rotational velocity response error, sine 
wave input, time-varying parameters. 
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Figure III-14. Rotational position responses of model, adapted plant, and 
unadapted plant, step input, time-varying parameters. 



Rotational 



Figure III-15. Rotational velocity responses of model, adapted plant, and 
unadapted plant, step input, time-varying parameters. 
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changed in some desired manner and the second being a disturbance in- 
put which reflects the presence of an internal or external effect on the 
system which cannot be manipulated as desired. One common disturbance 
for a system such as the Space Shuttle is wind gust. 

One of the inherent capabilities of an adaptive control system is 
the ability to "adapt" so as to be able to provide the desired response 
characteristics regardless of disturbances, unknown parameters, etc. 

A simulation study was performed in order to determine the effect due to 
wind gusts on the Space Shuttle vehicle compensated by adaptive control. 
The wind gusts were simulated by a step input at 3. seconds with a 
magnitude of 50% of the maximum control force available. Figures III-16 
and III-17 show the bending mode response of the unadapted plant, the 
adapted plant, and the model. The responses are shown for a wind gust 
in the positive direction in Figure III-16 and in the negative direction 
in Figure III-17. As can be seen from the figures, the adaption is very 
good and the plant closely tracks the model even with large disturbances. 
Figures III-18 and III-19 show the rotational position responses for the 
unadapted plant, the adapted plant, and the model for a positive wind 
gust and a negative wind gust, respectively. Figures III-20 and III-21 
show the rotational velocity responses for the unadapted plant, the 
adapted plant, and the model for a positive wind gust and a negative wind 
gust, respectively. Again, the adaption is seen to be very satisfactory 
and the adapted plant is very adequately compensating for the distur- 
bances. Figure III-22 shows a plot of the rotational position response 
error for no disturbance, a positive wind gust and a negative wind gust. 





Figure III-17. Bending mode response of model, adapted plant, and 
unadapted plant, negative wind gust. 


Rotational 



Figure III-18, Rotational position responses of model, adapted plant, and 
unadapted plant, positive wind gust. 
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Figure III-20. Rotational velocity responses of model, adapted plant, and 
unadapted plant, positive wind gust. 
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Rotational Position Response Error, deg. xlO 
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The response error becomes small with the disturbances acting on the 
system as it does without them. Thus , the response error is quite 
small which means that the adaptive system is adequately compensating 
for the disturbance effects and is tracking the model. 

A simulation study for the Space Shuttle vehicle was conducted with 
the thrust characteristics represented by a contactor mechanism with a 
dead-zone. The design technique developed in Section B of this chapter 
is applicable to this class of non-linear systems where the nonlinear 
and linear elements may be grouped as in Figure III-23. 

The simulation was made using CSMP with the unadapted plant and 
model having the same dynamic characteristics as described above for the 
linear case. Figure III- 24 shows the rotational position response ver- 
sus time for the unadapted plant, the adapted plant, and the model with 
a step command to the system. As can be seen from the figure, the 
unadapted plant response is grossly different from the adapted response. 
The model and adapted plant rotational position responses are virtually 
equal. The rotational position response error is shown in Figure HI- 
25 and can be seen to be quite small. Figure III-26 shows the phase- 
plant plot for the unadapted plant, the adapted plant, and the model. 
Figure III-26 shows that without adaptation, the system response is 
oscillatory whereas the adapted plant responds in a very satisfactory 
manner to the command input. 

Figure III-27 shows the rotational position response for the un- 
adapted plant, the adapted plant, and the model with an initial con- 
dition on the plant. The adapted plant is seen to have virtually the 




Figure III-23. Block diagram of non-linear system representation. 
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Figure III-24. Rotational position response curves 
adapted plant, and unadapted plant, 


of model, 
step command. 


Rotational Position Response Error, deg. xlO 





Figure III-26. Phase-plane plot of model, adapted plant, and 
unadapted plant, step command. 



Figure III-27. Rotational position response curves of model, adapted 
plant, and unadapted plant, initial condition. 
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same characteristics as the model whereas the unadapted plant response 
is oscillatory. Figure III-28 shows the rotational position response 
error as a function of time. This shows that the plant is tracking 
the model very closely. Figure III-29 is a phase-plant plot for the 
adapted plant, the unadapted plant, and the model. As can be seen from 
the figure, the adapted system has good damping whereas the unadapted 
plant is highly oscillatory. 




Figure III-28. Rotational position response error versus time, initial condition. 




Figure III-29. Phase-plane plot of model, adapted plant, 
and unadapted plant, initial condition. 


IV. FREQUENCY-DOMAIN MODEL REFERENCE ADAPTIVE 
CONTROL SYSTEM DESIGN 


This chapter presents the results of the present research in the 
area of frequency-domain design of model-reference adaptive control 
systems. In some adaptive control system applications, it may be more 
desirable, from an implementation standpoint, to provide adaptation 
by some means other than the technique presented in Chapter III. The 
model-reference adaptive control system design technique presented in 
this chapter provides adaptation by means of pre-filters and feedback 
filters. This design technique is for systems represented by a linear, 
time-invariant plant as in [6]. Plant adaptation is accomplished by 
having feedback filters and pre-filters with filter gains which are 
determined by the application of Liapunov's direct method to the system 
error equations. As a result of the application of Liapunov's direct 
method, the response error (model output minus plant output) is asymp- 
totically stable. The filters are designed so that the denominator of 
each filter transfer function is the same as the denominator of the 
model transfer function. This enables the basic filter networks to be 
utilized for various missions provided that the system model is valid 
for the different missions. The design technique is applied, as was the 
design method presented in Chapter III, to the Space Shuttle vehicle with 
linear characteristics and to the Space Shuttle vehicle with non-linear 
characteristics. The effect of wind gust disturbances on the vehicle 
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was also investigated as was the case of time-varying parameters. Sim- 
ulation results of the Space Shuttle vehicle show that the adaption is 
quite rapid and that the response error of the adapted system is greatly 
reduced as compared to the response error of the unadapted system. 

A. Problem Formulation 

The plant is assumed to be a linear time-invariant system which 
may be represented in the frequency-domain as: 


G p (s) 


b cp sC + b (c-l)p sC 1 +--- + b i p s + % 

sI1 + a (n-l)p sn_1 + a (n-2)p sI1 ~ 2 + “* + a lp s + a 0p 


(IV-1) 


where c < n - 1. The coefficients a n ..... a . and b rt ..... b are 
— Up n-ip Up cp 

assumed to be constant, unknown parameters and the polynomial f b s^ 

i-0 iP 

is assumed to have no zeros in the right-half plane. The model transfer 
function is assumed to be represented by: 


n-1 n-2 

b - . s + b s +...+ b s + b. 

(n-l)m (n-2)m lm Om 


Gm(s) = 


(IV-2) 


n n-1 n-2 

s + a s + a s +. . .+ a, s + a 

(n-l)m (n-2)m lm Om 


b (n-l)m are constants 


The coefficients a^,.... 


a (n-l)m an ^ b 0m»*** 


9 
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and the model transfer function is assumed to be a minimum-phase net- 
work. The response error in the frequency-domain is defined by the 
equation: 


E(s) A X (s) - X (s) 
— m p 


(IV-3) 


Thus, the object of the frequency-domain adaptive control research was 
to develope a design procedure for determining pre-filter and feed- 
back filters with characteristics directly related to the desired 
model in such a manner that the response error would be asymptotically 
stable. 

B. Development of Pre-Filters and Feedback Filters for General Fourth 
Order System 

In order to fully illustrate the design procedure the technique 
will be developed in detail for a general fourth order system and then 
extended to a general n tb order system. The basic system block dia- 
gram is shown in Figure IV-1. The additional input, U, which is the 
sum of the outputs of the pre-filters and feedback filters, is to be 
designed so that the plant will track the model. The general fourth 
order plant is assumed to be represented in the frequency-domain by: 


3 2 

b 3p S + b 2p s + b lp S + b 0p 


4 3 2 

s +a„s +a„s + a s + a 

3p 2p lp Op 


G p (s) - 


(IV-4) 




Model 



Adaptive 


Mechanism 


Error 


6 







IV-l . Basic system block diagram for frequency-domain technique. 
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The model is also assumed to be represented in the frequency domain 
by the relationship: 


3 2 

b s + b„ s + b, s + b^ 
3m 2m lm Om 


G m< s > " 


(IV-5) 


4 3 2 

s +a„s + a s + a s + a 

3m 2m lm Om 


Using Equations (IV-3) , (IV-4) , and (IV-5) , the following expression 
for the response error may be obtained. 


E(s)(s + a 3m s + a 2n s + a lm s + a Qm ) - 
3 2 

(a 3p ‘ a 3m )s V s) + (a 2p " a 2m )s X p (s) + (a lp ' a lm )sX p (s) 

3 2 

+ (a - a )X (s) + (b - b )s R(s) + (b - b )s R(s) 
Op Om p 3m 3p 2m 2p 


+ (b lm ” b lp )sR(s) + (b 0m - b 0p )R(s) - b 3p s U(s) 


- b 2p s U(s) - b ln sU(s) - b nn U(s) 


1P E 


J 0p 


(IV-6) 


This step is more easily illustrated in the time-domain. Equation (IV-4) 
may be represented in differential equation form as: 
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By subtracting Equation (IV— 7) from (IV-8) , adding and subtracting iden 
tical terms, the following expression may be obtained: 
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a 2m 


J— 

d 2 x 

P 


r 1 

d 2 X 

m 

+ a lm 

dx 

m 

dx 

P 

dt 2 

dt 2 _ 

_dt 

dt _ 


3 ,2 

d Xp d Xp 

+ a Om (x m ' x p> = (a 3p " a 3m ) — + (a 2p ' a 2m } — 


dt‘ 


dt 


dx r 


d 3 R 


+ (a - a ) + (a - a )x + (b - b ) 

Ip lm Op Om p 3m 3p o 

dt dt 


d 2 R 


dR 


+ (b - b ) h (b - b ) — + (b - b )R 

2m 2p 2 1“ IP dfc 0m °P 


- b. 


d 3 U 

d 2 U 

dU 

) 

b 2 p 

-”ip- 

dt 3 

dt 2 

dt 


) ^ V. 

Op 


(IV-9) 


Thus, taking the Laplace transform of the preceding expression gives 
Equation (IV-6) . 

Let us now make the following definitions : 

a l = (a 3p “ a 3m ) » a 2 = (a 2p " a 2m ) * a 3 = (a lp " a lm ) 


a = (a rt - a ), a = (b - b ), a - (b - b ) 
4 Op Om 5 3m 3p 6 2m 2p 


a 7 _ (b lm " b lp) ’ a 8 (b 0m _ hQp^ * a 9 b 3p 



95 


“10 = -b 2 p» a ll “ _b lp» “12 “ -b 0 p» and 


4 3 2 

A=s + a„ s + a„ s + a, s 
3m 2m lm 


+ a, 


0 m 


(IV- 10) 


Multiplying Equation (IV- 6 ) by s, using the definitions of Equation 
(IV- 10) and rearranging terms, the following expresssion may be obtained. 


Xp(s) 4 3 2 

sE(s) = (ot-^s + c^s + 03 s + a^s) 


R (s) 4 3 2 

+ (a,.s + a,s + a 7 s + a ft s) 


U(s) 3 2 

- „ 9 U(s) + [(a 3 m c 9 + « 10 >. + (a 2 m c 9 + o, u )s 


+ (a lm a 9 + a 12 )s + a 0 J 


(IV- 11) 


The terms involving ag m> a^ m , a 2 m> a^, and U(s) result from dividing 
4 

the expression s by A. The time-domain expression for the time deri- 
vative of the error may be found by taking the inverse Laplace Transform 
of Equation (IV-11) . Doing so gives the expression: 


-• A 


3, 


e(t) = a. T { 


X s X p (s) -f" s Xp (s) 

<—> + “2 x<— 


} + a- j { 


-1 

1 


s Z X p (s) 


} 


+ a 4 Ju { ~ } + a 5 ^ 


sX„(s) , -1 s^R(s) _p- 


r\ s^R(s) .f -1 s 2 R(s) 


-} + 


a 7 i 


{ } 
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+ “8 X ( ^> 

- « 9 u(t, + «, * •*?* + U(s), 

+ “10 X { s3 ” ts> } + «11 X ! ~^ ! + “12 X '^r 1 ' (IV-12) 


Let us now select u(t) as: 

u (t) = '''I KiZi (IV-13) 

i=l 

where K^, 1 = 1,..., 12 are filter gains to be determined via Liapunov's 
direct method and Z i9 i = 1 12 are given by the expression: 
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- X 


( a 3m s 3 + a 2m s2 + a lm s + a 0m> U C S > 


— I O - l 

i s J U(s) -f 

{ — > , Z 11 “ Xs < 


s^U(s) 

{ } 


Z 12 ' X 


(IV-14) 


Thus, Equation (IV-12) may be expressed as 

e(t) - — ^i a 9 ^ z i + (^2 — ^2 a 9^ Z 2 ^ a 3 — ^3 a 9^ Z 3 

+ (“4 " K 4 a 9 )Z 4 + (“ 5 ~ K 5 a 9> Z 5 + (“ 6 " K 6 “9 )Z 6 

+ (ay - Kyag)Zy + (ag - KgOg)Zg + (ag - Kgag) Zg 

d” — K 10 a 9^ Z 10 ^11 — K ll a 9^ Z ll ^ a 12 — K 12 a 9^ Z 12 (IV— 15) 


Equation (IV-15) may also be expressed by the summation: 

12 

e(t) = ^ (cii - K i ag)Z i (IV-16) 

i=l 

Thus , Equation (IV-13) gives the expression for the auxiliary input to 
the system which is a function of the pre-filter and feedback filter 
networks defined in Equation (IV-14). Equation (IV-16) gives the 
expression for the time derivative of the error as a function of the 
pre-filters and feedback filters and their gains. It is necessary, 
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then, using Liapunov's direct method to obtain an expression for the 
filter gains K^, i - 1,..., 12 in such a manner that the response error 
is asymptotically stable. 

Let us select a Liapunov function of the following form: 

12 i 2 

V = e 2 + l — [ (ou - K.ct 9 ) + 6.^)] (IV-17) 

i=l ^i 


where 8^ and 6^ are constants greater than zero. Thus, the V function 
of Equation (IV-17) is positive definite. The time derivative of 
Equation (IV-17) is given by the relationship: 


12 


V = 2ee + 2 £ ^-[(o^ - K^g) + S i (eZ i )] 
i=l e i 


[-Kia 9 + ^-^(eZi) ] 


(IV-18) 


Let us now assign K-^ the value 


i ± = ^(eZi) + ^“(eZi) 

ag 1 ag dt 1 


(IV- 19) 


Substitution of Equation (IV-17) and (IV-19) into Equation (IV-18) 
gives : 


12 


V = 2e l (a. - K a )Z 
i=l 


+ 


12 i 

2 ili k Ha ' 


l^ag) + 6 i (eZ i )]t-6 i (eZ i )] 


(IV- 20) 
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which may be written as : 



12 2 

l Vi 


i=l 


(IV-21) 


Application of Theorem II-4 thus shows that with the selection of K-^, 
i = 1,..., 12 as given by Equation (IV-19), that the response error is 
asymptotically stable. 

Integrating Equation (IV-19) gives the expression for the filter 
gains which are: 


: i ■ “i / (<s2 i 


) dir + p.(eZ.) + K.(t o ) 


i = 1,. . . , 12 


(IV-22) 


where a . 

l 


— and p . 
a 9 



Equations (IV-14) and (IV-19) then give the necessary relationships 
for the pre-filters, feedback filters and their gains so that the re- 
sponse error is asymptotically stable. 

As may be seen from inspection of Equation (IV-15) , the filters 
may be grouped into 3 filter networks as given by Equation (IV-23) . For 
mathematical convenience, frequency-domain notation will be used although 
the gains are time-varying quantities . 


Filter for Xp(s) 


K is 4 + K 2 s 3 + K 3 s 2 + K 4 s 


A 
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Filter for R(s) 

K 5 s 4 + K 6 s 3 + K 7 s 2 + Kgs 


A 


Filter for U(s) 


(K 9 a 3m + 


k 10 ) s 3 + (K9 a 2m + K u ) S 2 + 


<Vlm + 


K 12> s 


K n a n 
9 0m 


A 


(IV-23) 


C. Extension to General n th Order System 

The basic system block diagram is as discussed in Section B and is 
shown in Figure IV-1. The plant and the model are given by Equations 
(IV-1) and (IV-2) , respectively. 

Applying the methods of Section B, the expressions for Z^, i 
1 , . . . , 3n are given by : 

—i n -i n-1 , „ 

i s X p (s) -f s X p (s) 

{ — - — ) , Z 2 = X< f — > .... 




-i n. 


s R(s) 

{— } , 


n+2 


■ i 


-i 


sR(s) 

} >•••■ Z 0 _ = { - } , 


2n 
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-i 


(n-l)m' 


n-1 

s + a 


(n-2)nT 


+ ...+ a lm s + a 0m )U(s) 


^3n * 1 


(IV-24) 


T1 1 IX 2 

where A = s n + a (n _ 1)m s n_ + a (n _ 2)m s n " + ...+ a^s + a Qm . 
The filter gains K i9 i = 1,..., 3n are given by the expression: 


c i = °i /(eZ ± )d, + p^eZj.) + K^t^ 


(IV-25) 


where a,- = and p-r = . 

a 2n+l a 2n+l 

As for the system investigated in Section B, the pre-filters and feed- 
back filters and their gains given in Equations (IV-24) and (IV-25) , 
respectively, may be grouped into 3 filter networks as shown in Equation 
(IV-26) . 


Filter for X p (s) 


Ti lx* - 1 2 

K^s + K^s +. . .+ + K^s 


Filter for R(s) 


Kn +1 s n + Vrrt-Z**' 1 +•••+ K 2n-l s + K 2n^ 
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Filter for U(s) 


+ ...+ (K 2 m-i a i m 


+ K 3n )s + K 


2n+l a 0m 


A 


(IV-26) 


The generalized expression for the error equation is given by: 


e(t) 


3n 

I c«i - Ki“ 2 n+l) z i 

i=l 


(IV-27) 


In steady-state, the gains Ki, i = 1,..., 3n become constant and are 
given by: 


limit K£ 

t -*■ 00 


“2n+l 


(IV-28) 


D. Application of Design Technique 

A model of the National Aeronautics and Space Administration's 
Space Shuttle vehicle is used, as in Chapter III, in order to illustrate 
the application of the frequency-domain design technique. The design 
technique is applied to the same basic system configurations as was 
investigated in Chapter III. The Space Shuttle vehicle is investigated 
assuming both linear and non-linear characteristics. Simulation studies 



were made in order to determine the effect of wind gust disturbances 
on the adaption scheme. In addition, it is shown by simulation results 
that the adaption scheme may be applied to a time- varying system al- 
though the frequency-domain technique itself is not developed for the 
time-varying case. 

The dynamics used for the Space Shuttle vehicle in this study are 
as given below in the frequency-domain. The bending mode plant and model 
transfer functions, G Ep (s) and G Em (s) , respectively, are given by: 

X Ep (s) s 

G ( S ) = (IV- 29) 

L P R(s) + U E (s) s + .2s + 4 


and 


V s) 


% < s > ■ 

Em 


R(s) 


s + 2s + 4 


(IV- 30) 


The transfer functions for the rotational mode plant and model, denoted 
by Gpp(s) and Gp m (s) , respectively, are given by: 


G_„ (s ) = 


Xpp(s) 


s + 1 


(IV-31) 
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G 

pm 


(s) 


X (s) s + 1 

pm 

R(s) s 2 + 1.414s + 1 


(IV- 32) 


For the bending mode, the filters Z , i = 1,..., 6, from Equation 

IE 


(IV- 24) are: 


- 


IE 


sX Ep (s) 

A-r(s) 


} 


z = "f { s 2 R lg). } z = “f f sR(s) 1 

3E ^ ^ A E (s) } ’ Z « A K (s) } 


_ -f~'. (2a + 4)U(a ) . -f’’ 

Z5E ‘ ‘ 4 e (s) ’ ’ Z6E ‘ i- 


{ sU(sl } 

V s) 


where A (s) = s Z + 2s + 4. 

E 

The gains K , i= 1,..., 6, assumed to be zero at time zero, are given 
IE 

by the expression: 


t 

K iE = a iE / ^ e E z iE^ d7T + PiE^ e E Z iE^ ^ IV 33 ^ 

0 

where e E = x^ - x^. 

The filters for X Ep (s) , R(s) , and U^(s), from Equation (IV-26) are: 
Filters for X Ep (s) 


6 ^ 
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K 1E s + K 2E s 


Ap(s) 


Filter for R(s) 


K 3E s + K 4E s 


Aj?(s) 


Filter for Ug(s) 


(2K + K )s + 4K 

5E 6E 5E 

(IV- 34 

V s> 

For the rotational mode, the filters Z^, i = 1,..., 6, from Equation 
(IV-24) are: 


_ -/•* s 2 x pp (s) = r sXp p (s) , 

!p ^ { A p (s) } ’ 2 P ^ A p (s) } ’ 


-£ 


{^■} , > 

A p (s) A p (s) 




{ (1.414s+l)U(s) } z 
A p (s) ’ 6 P 


- 

A p (s) 


where A (s) = s + 1.414s + 1 
P 
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The gains , i = 1,..., 6, assumed to be zero at time zero, are 
given by the expression: 


Kip = °ip f (e p Zip) dlT + Pip( e p z ip) 


(IV- 36) 


where & = - x_„ 

P pm PP 


The filters for Xpp(s), R(s), and Up(s), from Equation (IV-26) 


are: 


Filter for Xp p (s) 


K lp s + K 2 P S 
A d (s) 


Filter for R(s) 


K3p s K4p s 


A p(s) 


Filter for U p (s) 


(1.414K 5p + K^s + K 5p 


A p ( S ) 


(IV-37) 
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The system with pre-filters and feedback filters was simulated as 
in Chapter III with CSMP. Two system inputs were investigated for the 
linear case, the first being a sine wave input and the second a step 
input. Figure IV-2 shows the bending response of the unadapted plant, 
the adapted plant, and the model for a sine input to the system. The 
gains o^e and P^e, i = 1,..., 6 are 20. and 30., respectively. Figure 
IV-3 shows the bending response of the unadapted plant, the adapted 
plant, and the model response with a step input to the system. The 
gains o^e and PiE are as in the previous figure. As can be seen from 
these figures , the adaptation is rapid and the plant tracks the model 
very closely. 

Figures IV-4 and IV-5 show the rotational position and velocity 
response of the unadapted plant, the adapted plant, and the model for 
a sine wave input to the system. For these figures, the gains and 
P^p, i = 1,..., 6 of Equation (IV- 36) are 20. and 30., respectively. 
Figures IV-6 and IV-7 show the same responses except with the system 
having a step input. As can be seen from the figures, the response 
error is very small for both a sine wave input and a step input. The 
adapted plant and model responses are virtually indistinguishable for 
the rotational position and velocity for the system with either a sine 
wave input or a step input. 

The design technique developed in this chapter was not developed 
for a system with time-varying parameters. However, a simulation study 
was made in order to determine if the design technique would provide 




IV-2. Bending mode responses of model, adapted plant, and 

unadapted plant, sine wave input, frequency-domain technique. 
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IV-3. Bending mode responses of model, adapted plant, and 

unadapted plant, step input, frequency-domain technique. 
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Rotational velocity, deg. /sec. xlO 



IV-5. Rotational velocity responses of model, adapted plant, 

and unadapted plant, sine wave input, frequency-domain technique. 
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IV-6. 


Rotational position responses of model, adapted plant, and 
unadapted plant, step input, frequency-domain technique. 
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Rotational velocity, deg. /sec. xlO 



IV- 7. 


Rotational velocity responses of model, adapted plant, and 
unadapted plant, step input, frequency-domain technique. 
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adaptation for a system with some time-varying parameters. For the 
bending mode, the plant was assumed to be represented by: 



(s) 


s 

s 2 + CgS + 4 


(IV-38) 


where varies linearly from 0. to .2 in 5. seconds. For the rota- 
tional mode, the plant was assumed to be represented by 



(s) 


s + 1 
s 2 + C p 


(IV-39) 


where C p varies linearly from -.2 to 0. in 5. seconds. For mathe- 
matical convenience, frequency-domain notation is used. Figures IV- 8 
and IV-9 show the bending mode response for the unadapted plant, the 
adapted plant, and the model for a sine wave input and a step input. 

As can be seen from the figures , the adaption is not seriously affected 
and the plant tracks the model very closely. Figures IV-10 and IV-11 
show the rotational position and velocity, respectively, of the un- 
adapted plant, the adapted plant, and the model with a sine wave input 
to the system. Figures IV-12 and IV-13 show the same responses with a 
step input to the system. The time variations for Figures IV- 7 through 
IV-13 were as noted above. Again, it is seen that the time-varying 
parameters do not seriously effect the adaptation. 



Bending, meters xlO 



IV-8. Bending mode responses of model, adapted plant, and unadapted plant, 
sine wave input, time-varying parameters, frequency-domain technique. 
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Bending, meters .xlQ 



IV-9. Bending mode responses of model, adapted plant, and unadapted plant, 
step input, time-varying parameters, frequency-domain technique. 
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Rotational position, deg. xlO 



IV-10. Rotational position responses of model, adapted plant, and unadapted plant, 
sine wave input, time-varying parameters, frequency-domain technique. 
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Rotational velocity, deg. /sec. xlO 



IV-11. Rotational velocity responses of model, adapted plant, and unadapted plant, 
sine wave input, time-varying parameters, frequency-domain technique. 
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Rotational position responses of model, adapted plant, and unadapted 
plant, step input, time-varying parameters, frequency-domain technique. 




Rotational velocity, deg. /sec, xlO 



IV-13. Rotational velocity responses of model, adapted plant, and unadapted plant, 
step input, time-varying parameters, frequency-domain technique. 
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As was discussed in Section C of Chapter III, one of the inherent 
capabilities of a "good" adaptive control system is the ability to 
"adapt" so as to be able to provide the desired response characteristics 
regardless of disturbances, unknown parameters, etc. With the adapta- 
tion of the Space Shuttle being provided via the frequency- domain design 
technique, a simulation study was performed in order to determine the 
effects on the vehicle due to wind gusts. As in Chapter III, the wind 
gusts were simulated by a step input at 3. seconds with a magnitude of 
50% of the maximum control force available. Figures IV-14 and IV-15 
show the bending mode response of the unadapted plant, the adapted plant, 
and the model. The responses are shown for a wind gust in the positive 
direction in Figure IV-14 and in the negative direction in Figure IV- 
15. The figures show that the adaptation provided by the frequency- 
domain method compensates successfully for the large disturbances and 
the plant tracks the model very closely. 

Figures IV-16 and IV-17 show the rotational position responses for 
the unadapted plant, the adapted plant, and the model for a wind gust 
in the positive direction and a wind gust in the negative direction, 
respectively. Figures IV-18 and IV-19 show the rotational velocity 
responses for the unadapted plant, the adapted plant, and the model for 
a wind gust in the positive direction and in the negative direction, 
respectively. As in the case of the bending mode, Figures IV-14 through 
IV-19 show that the adaptation provided by the frequency-domain design 
technique compensates very adequately for the wind gust disturbances. 




IV-14. Bending mode responses of model, adapted plant, and unadapted 
plant, negative wind gust, frequency-domain technique. 
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Bending, meters xlO 



IV-15. Bending mode responses of model, adapted plant, and unadapted 
plant, positive wind gust, frequency-domain technique. 
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IV-16, Rotational position responses of model, adapted plant, and unadapted 
plant, positive wind gust, frequency-domain technique. 
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plant, positive wind gust, frequency-domain technique. 
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Thus, even for large wind gust disturbances, the system adapts so that 
the plant tracks the model very accurately. 

The frequency-domain design technique was investigated, as was the 
time-domain technique of Chapter III, for the Space Shuttle vehicle with 
the thrust characteristics represented by a contactor mechanism with a 
dead-zone. Figure IV-20 shows the rotational position response versus 
time for the unadapted plant, the adapted plant, and the model with a 
step input command to the system. As can be seen from the figure, the 
unadapted plant response is substantially different from the adapted 
response whereas the adapted response and the model response are vir- 
tually indistinguishable. The actual rotational position response error 
is shown in Figure IV-21 and is seen to be quite small. Figure IV-22 
shows a phase-plane plot for the unadapted plant and the adapted plant. 

As was shown in Chapter III, the unadapted response is oscillatory. How- 
ever, the adapted plant responds in a very satisfactory manner as the 
plant closely tracks the model. Figure IV-23 shows the rotational posi- 
tion response for the unadapted plant , the adapted plant , and the model 
with an initial condition on the plant. As with the previous case, the 
adapted plant and model responses are virtually the same whereas the 
unadapted plant response is grossly different. Figure IV-24 shows the 
actual rotational position error as a function of time. This shows 
that the response error is very small which implies that the plant is 
tracking the model very accurately. Figure IV-25 shows a phase-plane 








4), deg. /sec. 



-22. Phase-plane plot of model, adapted plant, and unadapted 
plant, step command, frequency- domain technique. 
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Rotational position, deg. xlO 


10 . 



IV-23. Rotational position response curves of model, adapted plant, 

and unadapted plant, initial condition, frequency-domain technique 
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plot for the adapted plant and the unadapted plant. As was shown previ- 
ously, the unadapted system is highly oscillatory. However, the adapted 
system, using the frequency-domain design technique, is well damped and 


tracks the model with little error. 



V. AN APPLICATION OF SENSITIVITY COEFFICIENTS TO THE DESIGN 
OF MODEL-REFERENCE ADAPTIVE CONTROL SYSTEMS 

The purpose of this chapter is to discuss an application of sensi- 
tivity coefficients [16], [17], and [18]. Sensitivity coefficients are 
shown to be applicable to the design of model-reference adaptive control 
systems. In particular, they are applied to the adaption of the Space 
Shuttle vehicle which was investigated in Chapters III and IV. 

In this application of sensitivity coefficients, it is assumed that 
the plant parameters while being unknown, are constant. The model re- 
sponse, as in all model-reference adaptive control schemes, is considered 
to be the desired response. The object of the adaption process is to 
use the sensitivity coefficients in a manner so as to change some of the 
plant parameters, which in general will have non- ideal values, so as to 
cause the plant to track the model. 

A. Definition of Sensitivity Coefficient 

Let us now define the sensitivity coefficient as in [19]. Let the 
output of a system be denoted by x(t, p^> P 2 ) where p^ and P 2 are nominal 
parameter values. If the parameter p-^ varies from the nominal value by 
some value Ap^, the output is then given by x(t, p^ + Ap-^, P 2 ) • The 
sensitivity coefficient is defined by: 


x(t, p x + Ap^ p 2 ) - x ( t , p x , p 2 ) 


limit 

Ap^ -*• 0 


Api 
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(V-l) 
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which is the partial derivative of x(t, p-^, P2) with respect to p^ 
evaluated at the nominal parameter values. Thus, the sensitivity coef- 
ficient for p is the partial derivative of the system output with 

K. 

respect to a system parameter p^ and will be denoted by . 

B. Use of Sensitivity Coefficients in Model-Reference Adaptive Control 
System Design 

One model-reference adaptive control method in which sensitivity 
coefficients may be utilized is a technique developed by Osburn [8] . 
Osburn defines the optimum performance as that which results when the 
system parameters are adjusted to produce a minimum of some specified 
Performance Index. The performance index selected was: 


P. I. = 



f (e)dt 


o 


(V-2) 


The interval {t , t, ] is of sufficient length to include most of the 
dynamic response of the system for an input at time t and f(e) is an 
even function of the error. The function selected for investigation 
by Osburn was 


f (e) = 1/2 e 2 


(V-3) 


It was then concluded that each adjustable parameter, p^, should be 
changed continuously at a rate proportional to the negative of the 
partial derivative of f(e) with respect to p^. In equation form, this 
is given by : 
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Pk = -S k f'(e) 


3e 

9p k 


(V-4) 


where is a constant. For the f(e) used, which is given in Equation 
(V-3) , the adaptive parameter rate may be written as : 


. 3e 

P = -S, e 

k k 3p 


(V-5) 


Now consider the term . For the model-reference adaptive control 

3p k 

system, the response error is given by: 


e " “ *p 


(V-6) 


Taking the partial derivative of Equation (V-6) with respect to the 


parameter Pk gives 
3e _ 9xp 

3p k 9P k 


(V-7) 


3x m 

The term — — is equal to zero because the model does not contain any 

9p k 

adaptive parameters. Examination of Equation (V-7) shows that the term 

—— is the negative of the previously defined sensitivity coefficient. 
“Pk 

Thus, the rate for the adaptive parameter p^ may be rewritten in terms 
of the response error and the sensitivity coefficient as: 

3xp 

9Pk 


Pk " s k e 


(V-8) 
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Integrating Equation (V-8) , the adaptive parameters are: 


p k ' s k 


/ 9x 

<e '3^ )d ’ + P k (t o ) 


(V-9) 


In general, however, it is not possible to determine because 
this requires a knowledge of the plant parameter values and this lack of 
information is one of the primary motivations for using an adaptive sys- 
tem. Thus, it is necessary to approach the problem in a different manner. 
Hence, the following assumption is made [11]: If the response of the 

plant approximates that of the model, then the sensitivities of the 
model approximate the true sensitivities of the plant. With this 
assumption, the model parameter values may then be used in order to 
evaluate the sensitivity coefficients necessary for the implementation 
of Equation (V-9) . 

Although Equation (V-9) provides a method for system adaptation, it 
should be noted that there is no provision for insuring the stability of 
the response error as was done in the design techniques of Chapters III 
and IV. 


C. Generation of Sensitivity Coefficients 

The sensitivity coefficients necessary for implementation of the 
adaptive scheme will be generated as in [19]. Consider the general case 
of a system described in the frequency domain by 
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C(s) N 


R(s) 


s m + b s m- -*- +. . .+ b is + b 
m-1 1 0 


m . m-1 . . , 

s + a m -l s +•••+ a^s + ag 


(V-10) 


The partial derivative of C with respect to a parameter p^ is 


„ , 3N 3D 

3C R(D r— - Nt — ) 

9p i 3p i 


(V-ll) 


3 Pj 


By using Equation (V-10), Equation (V-ll) may be rewritten as: 


3C 

3 Pj 


R 3n 
D 3p 


C 3D 


(V-12) 


j 


D 3p • 


A signal-flow graph of Equation (V-12) is shown in Figure V-l. Thus, 

the input to the system in Figure V-l is R, then the sensitivity coef- 
3C 

fient is a summation of the signals present at the M , i = 0 ,..., 

3Pj X. 

nodes of the system model and the signals present at the S^, H = 0,... 

m-1 nodes of the sensitivity model in accordance with the equation: 


1 C - -Y (M> - S>) 


3p. 


J 1=0 


' 3 Pi 


3Pi 


if 


m-1 


(V-13) 
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3b o 93o 

The and are evaluated at 

set. 


the nominal values of the parameter 


D. Application to Space Shuttle Vehicle 

The design procedure defined by Equation (V-8) was applied to the 

Space Shuttle vehicle. The model and plant are as described in Section 

D of Chapter IV and which are repeated here for convenience. The bending 

mode plant and model, G (s) and (s) , respectively, are: 

Ep Em 


x Ep( s ) 

R(s) 


- V s) 


s 


s 2 + (.2 + p )s + 4 
2E 


(V-14) 


and 


X Em (s) 

R(s) 


" G Em< S > 


s 


2 

s 


+ 1.414s + 1 


(V-15) 


For the rotational mode, the plant and model transfer functions, denoted 

by G (s) and G (s) , respectively, are: 

PP P“ 


X (s) 

- E5 — " G n (3) 
PP 


s + 1 


2 

s + p 2p S + P lp 


(V-16) 


R(s) 
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and 


X (s) 

P m _ = G (s) 

pm 2 


s + 1 


(V-17) 


RCs) 


s + 1.414s + 1 


Applying the methods of Section C, the sensitivity coefficient 


9X, 


er 


9p 


may 


2E 


be generated as shown in Figure V-2 and the sensitivity coefficients 
— and — ^ may be generated as shown in Figure V-3. 

9p lp 9p 2p 

The method utilizing sensitivity coefficients was applied to t,he 
Space Shuttle vehicle assuming first a sine wave input and then a step 
input. Figures V-4 and V-5 show the bending mode responses for the 
model, the adapted plant, and the unadapted plant for a sine wave input 
and a step input, respectively. As can be seen from the figures, 
adaption is occuring, but at a slow convergence rate. Figures V-6 and 
V-7 show the rotational position and velocity responses for the model, 
the adapted plant, and the unadapted plant for a sine wave input. The 
figures show that adaption is occuring, but at a slow rate. Several 
seconds are necessary before the adaption has a noticeable effect on 
the system. Figures V-8 and V-9 show the rotational position and veloc 
ity responses for the model, the adapted plant, and the unadapted plant 
for a step input to the system. Again, the figures show that the 
adaption convergence is slow. The adapted system is much more oscil- 
latory than the model, but the plant does track the model after a 





3X 3X 

PP PP 

V-3. Signal-flow graph for generation of — and — 

9p lp 9p 2p 


145 





Bending, meters xlO 



V-4. Bending mode responses of model, adapted plant, and unadapted plant, 
sine wave input, sensitivity coefficient method. 
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Bending, meters xlO 



V-5. Bending mode responses of model, adapted plant, and unadapted 
plant, step input, sensitivity coefficient method. 


Rotational position, deg. xlO 



'-6. Rotational position responses of model, adapted plant, and unadapted 
plant, sine wave input, sensitivity coefficient method. 


Rotational velocity, deg. /sec. xlO 



V-7, Rotational velocity responses of model, adapted plant, and unadapted 
plant, sine wave input, sensitivity coefficient method. 
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12.1 



V-8. Rotational position responses of model, adapted plant, and 

unadapted plant, step input, sensitivity coefficient method. 
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V-9 . Rotational velocity responses of model, adapted plant, and 

unadapted plant, step input, sensitivity coefficient method. 
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sufficient period of time. Figure V-10 shows plots of the rotational 
position response error versus time for the Space Shuttle vehicle 
adapted with the method utilizing sensitivity coefficients and with the 
time-domain technique developed in Chapter III. Clearly, the response 
error is significantly less with the time-domain technique. 



Rotational position response error, deg. xlO 



V-10. Rotational position response error for time-domain 
adaptation and sensitivity coefficient adaptation. 
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VI. CONCLUSIONS 


In this report, the problems associated with the design of model- 
reference adaptive control systems were considered and solutions to these 
problems were advanced. Stability of the adapted system was a primary 
consideration in the design techniques developed. Thus, Liapunov's direct 
method formed an integral part of the development of both the time- 
domain and frequency-domain design techniques. 

The basic stability definitions, theorems regarding Liapunov 
stability and their application as well as a justification for the use 
of Liapunov's direct method in the design of model-reference adaptive 
control systems are presented in Chapter II. 

A time-domain model-reference adaptive control design technique is 
presented in Chapter III. This represents a significant extension of 
previous design techniques. With the design technique developed in 
Chapter III, adaption to the system is a function of the response error 
and the plant states as well as the derivative and integral of these 
quantities. Results obtained from the application of this design tech- 
nique to the Space Shuttle vehicle show that the response error is less, 
the plant more favorably tracks the model and, in general, better system 
adaptation is achieved than with previous methods. Results also show 
that very successful adaptation is obtained even with large wind gusts. 
Good adaptation is also achieved with non-linear system characteristics 
as well as with linear system characteristics. 
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A frequency-domain model-reference design technique is presented 
in Chapter IV. Physically realizable feedback filters, pre-filters 
and the filter gains are designed so as to provide system adaptation. 

The approach to the problem was influenced by the fact that an adaptive 
system in which the same basic filter networks could be utilized for a 
number of missions was desired. As for the time-domain design method of 
Chapter III, stability of the adapted system was incorporated in the 
development of the design technique via Liapunov's method. Results 
obtained from the application of this design technique to the Space 
Shuttle vehicle showed that excellent system adaptation was obtained 
and the plant, even with severe wind gusts, successfully tracks the 
model. Non-linear as well as linear system characteristics were studied 
and the results showed that system adaptation was excellent for either 
case. 

Sensitivity coefficients were shown, in Chapter V, to be applicable 
to the design of model-reference adaptive control systems. Results 
obtained from the application of a design technique utilizing sensitivity 
coefficients to the Space Shuttle vehicle with linear characteristics 
showed that system adaptation was achieved. However, the adaptation 
is much slower and causes a much larger response error than either of 
the design techniques developed in Chapters III and IV. 

The use of multiple force points should be investigated. For 
example, in addition to the on-off thrust characteristics of a reaction 
jet control system, the use of control forces available from aerodynamic 
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surfaces may be desirable. The inter-relationship of these various 
forces on the adapted system should be investigated. The investigation 
of optimal adaptive system convergence rates and their relationship with 
the dead-zone boundaries of the adapted system should also be investi- 
gated. Another item of much practical significance would be a study 
to determine the range of variations of various system parameters such 
as mass, moment of inertia, center of gravity, etc., that could be 
tolerated by the adaptive system without having to do additional detailed 
pre-flight studies. A study to determine the technique that could be 
most easily implemented on a digital computer is also recommended. 
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